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(57) Abstract: A first pattern (A) is represented by a first ordered set of elements 
(Xi) each having a value whilst a second pattern (B) is represented by a second 
ordered set of element (uj) each having a value. The patterns are analysed by itera- 
tively performing the steps of: selecting (e.g. at random) a pluralitym of elements 
from the first ordered set; for each selected element Xf of the first ordered set, se- 
- lecting an element u,- from the second ordered set, such that the selected elements 
of the second ordered set have, within the second ordered set, a set of positional 
relationships relative to each other that is the same as, or a transformation of, the 
set of positional relationships that the selected plurality of elements of the first or- 
dered set have relative to each other, comparing the value of each of the selected 
elements of the first ordered set with the value of the correspondingly positioned 
selected element of the second ordered set in accordance with a predetermined 
match criterion to produce a decision that the selected plurality of elements of the 
first ordered set does or does not match the selected plurality of elements of the 
second ordered set; and in the event of a match, updating at least one similarity 
score (Sab)- In the selection of the elements of the second ordered set, one chooses 
(e.g. at random) at least one parameter (R, p, a) and selects elements having a set 
of positional relationships (dj', dj'*)) that is transformed from the positional rela- 
tionship set di of the selected elements of the first ordered set in accordance with 
the parameter(s). This transformation may include one or more of rotation, reflec- 
tion or scaling. Other aspects include biasing the selection of the elements of the 
first ordered set towards a large extent, and of introducing variations in the number 
of elements selected, with the similarity score being updated by an amount that is 
a function of the number of elements. The method may also be applied to a single 
image. 
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Analysis of Patterns 

The present invention is concerned with comparing one pattern with another, or of a 
pattern with itself, and is of particular interest in the comparison of two-dimensional patterns such 

5 as visual images, although applicable also to one-dimensional patterns and patterns having three or 
more dimensions. Standard approaches to pattern recognition use templates to recognise and 
categorise patterns [1]. Such templates take many forms but they are normally produced by a 
statistical analysis of training data and matched with unseen data using a similarity measure [2]. 
The statistical analysis is normally carried out over a number of intuitively selected features that 

10 appear to satisfy the needs of the recognition task. For example, in speech recognition templates 
can be encapsulated as Hidden Markov Models derived in the frequency domain and in Optical 
Character Recognition the templates take the form of the character fonts themselves. In the case of 
face recognition a number of intuitive^ chosen features such as skin texture, skin colour and facial 
feature registration are used to define face templates [5]. In a CCTV surveillance application 

15 intruders are normally detected through a process of frame subtraction and background template 
modelling which detects movement and removes background effects from the processing [3]. In 
many cases the number of features leads to a computationally unmanageable process and Principal 
Components Analysis and other techniques are used to scale down the problem without 
significantly reducing performance [http://www>partek.com/index,html] . These approaches 

20 achieve great success in non-noisy envh-onments but fail when the pattern variability and number 
of pattern classes increase. 

Some techniques for analysis of images or other patterns where the pattern is compared 
with other parts of the same pattern are described in our earlier patent applications as follows. 

European patent application 00301262.2 (publication No. i 12641 1) (applicants ref. A25904EP#); 

25 International patent application PCT/GBO 1/00504 (publication No. WO 01/61648) (applicants ref. 
A25904WO); 

International patent application PCT/GBO 1/03 802 (publication No. WO02/21446) (applicants ref 
A25055WO); 

U.S patent application 977,263/09 filed 16 October 2001 (publication No. 20020081033) 
30 (applicants ref A25904US1); 

- as well as the following papers published by the mventor: 
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Stentiford F W M, "An estimator for visual attention through competitive novelty with application 
to image compression", Proc. Picture Coding Symposium 2001, Seoul, 25-27 April, pp 101 - 104, 
2001. 

Stentiford F W M, "An evolutionary programming approach to the simulation of visual attention", 
5 Proc. Congress on Evolutionary Computation 2001, Seoul, pp 851 - 858, 27 - 30 May, 2001. 

Methods and apparatus for comparing patterns are described in our earlier international 
patent application WO03/081523. 

Aspects of the present invention are set out in the claims. 

Some embodiments of the present invention will now be described, with reference to the 
10 accompanying drawings, in which: 

Figure 1 is a block diagram of an apparatus for performing the invention; 

Figure 2 is a diagram illustrating operation of tiie mvention; 

Figure 3 is a flowchart of the steps to be performed by the apparatus of Figure 1 in 
accordance with a first embodiment of the invention; 

15 Figure 4 is a flowchart of the steps to be performed by the apparatus of Figure 1 in 

accordance with a second embodiment of the invention; and 

Figure 5 illustrates a pair of images. 

Figure 1 shows an apparatus consisting of a general purpose computer programmed to 
perform image analysis according to a first embodhnent of the invention. It has a bus 1, to which 
20 are connected a central processing unit 2, a visual display 3, a keyboard 4, a scanner 5 (or other 
device, not shown) for input of images, and a memory 6. 

In the memory 6 are stored an operating system 601, a program 602 for performing the 
image analysis, and storage areas 603, 604 for storing two hnages, referred to as image A and 
unage B. Each image is stored as a two-dimensional array of values, each value representing the 
25 brightness of a picture element within the array. It will be imderstood, however that the apparatus 
might more generally be arranged to analyse data sets other than images, in which case the storage 
areas 603, 604 would each contain a data set A, B, each being an ordered set of value, ordered in 
any number of dimensions (the same number of dimensions in each set). 

The image arrays are shown schematically in Figures 2a and 2b. Image A consists of an 
30 array of picture elements X| =( jcj, yO where Xi and yi are the horizontal and vertical positions of the 
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elements witiiin the image, A 20x20 array is shown, for the purposes of illustration. In the general 
case, X| =( Xiu xo^xq, ... ^in) where xg are tiie n coordinates of 5 in n dhnensions. Each element has 
arespectivevaluea = a(i). This may be a scalar value a or vector (multidimensional) value a. In 
the case of an image these would be the brightness a, or alternatively a set of colour components 
5 such as (in r,g,b representation) a = (a^ at) Similarly, the image B consists of an array of 
picture elements a = (ui, Vj) havmg brightness values b(uj}. In the general case, u^ =( uiu Wi2, "is. ... 

Win). 

Figure 3 is a flowchart e?q}lauiing the application of the method as applied to two- 
dimensional images A, B . In Step 200, a score Sab is set to zero, and (201) a counter t set to zero. 

10 The first task of the method is to make a random selection of elements m image A. This 

may be visualised as stabbing the image with an irregular fork having m tines. The actual number 
m of elements may be selected (Step 202) at random 'within the range n\nm:^m<mmax, or m may be 
fixed, in which case Step 202 would be omitted. The fork size is limited by a diameter D selected 
as a random number Dmb^D^Dmax (Step 203). Other approaches to varymg the distribution of fork 

1 5 size will be discussed later. Note that, throughout tiiis specification, references to a random 

selection also envisage the possibility of selection by means of a pseudo-random process. Also, a 
reference to random selection envisages the possibility not only of a random selection for which 
the selection of any value (within a range specified) is equally probable, but also of a selection in 
accordance with a non-uniform probability distribution. 

20 At Step 204 a set Nx of m elements at random positions Xi are selected, subject to the 

constraint that all elements lie within the image and all elements lie within a circular aiea of 
diameter D. One possible method of doing this is as follows: 

2041 Choose a random element Xq in A. 

2042 Choose a set of random displacements di = (dxi, dyO, where 0 ^ d^i ^ D/2 and 0 ^ dyi ^ 

25 D/2. 

2043 If the Euclidean distance |di| < D/2, then continue; otherwise repeat the previous step 
until this condition is satisfied. Where |di| = V{ d^i^ + dyi^} . 

2044 Compute positions Xj = xq +d| 

2045 If any xj lies outside the image area, repeat steps 2042 to 2045 in respect of the 
30 offending di. 

Note that this process permits the occurrence of one or more pairs Xi = xj i^j i.e. the Xj are 
not constrained to be distinct. This is not objectionable in practice but if desired may be 
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eliminated by testing for it and reselecting one member of the matching pair in the same way as for 
elements falling outside the image area.. 

The next stage (Step 205) is to make a selection Nu of m elements uj within image B, at a 
random overall position, but having the same positions relative to one another as the selected 
5 elementsof image A. Thatis,Xi-Xj==Ui-Uj for all ij. This may be visualised as stabbmg image 
B with the same fork as used on image A. 

Assuming that a set of displacements di have been calculated as above, this can be done 

by: 

2051 Choose a random element uo in B. 
10 2052 Compute positions Ui = uo +d| 

2053 If any Ui lies outside the image area, repeat steps 2051 to 2043 in respect of the 
offending dj. 

At step 206 it is determined whether each of the selected elements in image A matches the 
element havmg the same relative position in image B. Where the value associated with each 
15 element is a scalar value, m this case representing brightness, the test is that a match is deemed to 
occur if 

|a(Xi)-h(ui)|< 5 foralli=l ...m 
where 5 is some small threshold value 

In the vector case (e.g. r, g, b) a match occurs if 

20 Dist[a(xi) - b(ui)] < 5 for all i = 1 ... m 

Where Dist is some distance operator (e.g. Euclidean or city-block), or the vector 
components may be thresholded separately, e.g. for colour components 
|br(Xi)-br(ui)|< 5r and 
|be(Xi)-bg(ui)|< 5g and 
25 |b5(Xi) . bb(ui)| < 6i, for all i = 1 ... m. 

If a match occurs, then at Step 207 the Score Sab is incremented. It could simply be 
incremented by 1 (or other fixed value). Where m is variable, the score could if deshred be 
incremented by m or some function of m (to be discussed below). 

Once the score has been updated, or if no match occurred, then the iteration counter t is 
30 tested at 209 to see if it has reached a maximum iteration coimt T, and if so, the process 
termmates. Otherwise the process returns to Step 202 for a further iteration. 
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A discussion of fork diameter is in order. If small forks are used, then the score or 
similarity measure will depend on local similarities and will assume high values if one image 
possesses many regions that are siniilar to those in the other. Large diameters give more weight to 
larger-scale similarities between images. If D is fixed, then one has a certain statistical distribution 
5 of actual fork diameters ranging from very small up to the maximum permitted by the particular 
value of D (by actual diameter we mean the diameter of the smallest circle that can enclose all the 
elements Xi on a particular iteration). The random selection of D m the range Dniu;^D<Dn,ax allows 
actual diameters up to Dmax hut skews their statistical distribution by favouring actual diameters 
less than Dmm at the expense of diameters between Dmm and Dmax- 

10 Alternative methods of skewing this distribution can be envisaged (includmg the 

possibility of favouring larger forks); for example one could proceed with a fixed value of D, then, 
for each selection of a set of di (i = 1, ... m) one could calculate the actual diameta* (or an estimate 
of it such as V{[Max(dxi) - Min(dxi)]^ + [Max(dyi) - Min(dyi)]^}) and discard the set or not with a 
probability corresponding to a desired function of the actual diameter. 

15 Turning back to the score-incrementing step, in the case of variable m, the information 

value of a match rises according to its rarity. Thus a match obtained usmg a fork with many tines 
is more significant than one obtained using few tines. Hence the suggestion above that the match 
be incremented by m. More generally, one might increment the.score by some monotonically 
increasing function f(m) of m rather than m itself. Functions that rise more rapidly than m itself 

20 may for example be used (such as m^or2"). 

We turn now to a second embodiment of the invention, whidi introduced a number of 
additional transformations of the fork applied to image B. The following description omits the 
random variation of m and D. discussed above, though these could be included (or not) if desked. 

The idea here is to allow matches to be obtained, and hence contributions to the total score 
25 to be generated, in situations where a feature appears in one image whilst a similar feature appears 
in the other image but is of a different size, is reversed, or is rotated with respect to the one in the 
first image. This is achieved by applying to image B a fork that is not the same as that applied to 
image A but is a scaled and/or reversed and/or rotated version of it 

Figure 4 shows a flowchart. Steps that are identical to those in Figure 3 are given the same 
30 reference numerals. Steps 2041 to 2045 are not shown explicitly. 

Followmg Step 204, a random reflection is applied to the fork: 
Choose a random integer R as 0 or 1; 
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If R = 1, set dxi = - dxi for all i = 1 ... m. dyj are unchanged. 

This is a reflection about a single vertical axis. Reflections about other axes are 
encompassed by this reflection plus the rotation step that comes next. 

Next (Step 21 1) choose a random rotation angle P in the range p^ax to Pmin. Then (212) the 
5 fork represented by di is rotated by this angle by perfonning, for each i: 
djd* = dxi.cosP - dyi.sinp 
dyi' = dxi.sinp + dyi.cosp. 

Thirdly, in Step 213, a random scale factor a is chosen in the range Ontm to Onux* The fork 
is then scaled at 2 14 by this factor: 
10 dxi" = a.dxi' 

d/' = a.dyi' 

The scaling and rotation are relative to (0,0), though scalmg or rotation about any other 
centre would do just as well. ^ 

If desired, it would be possible to define Ox, Oy separately in x and y directions, for 
IS example to spot longer or taller versions of the same shapes. 

Step 215 then follows to determine the elements Ui This is identical to Step 205 except 
that it uses the transformed di" rather than di. Note that there is a possibility that the selection of 
the transformations, or even of dj, may mean that it is difGcult or even impossible to find, in Step 
215 (which comprises the substeps 2051 to 2053 described earlier), a position uo such that all 
20 elements Ui lie within image B. Thus, although not shown in the flowchart, it may be necessaiy in 
such an event to return to step 210 for a fresh selection of the transformation(s) or even return to 
step 204 for an entirely new fork. 

Steps 206 to 209 are as described earlier. 

By way of illustration. Figure 5 shows the two dimensional case in which a fork with m = 
25 4 pixels x in image A is matched with 4 pixels u in image B after a 90^ rotation and a 25% scale 
reduction. Each of the pixels might possess three colour intensities, so a = (ar, ag, ab) and the 
pixels u match the x if the colour intensities of all m corresponding pixels have values within Sj of 
each other. 

Note that the reflection, rotation and scaling are linear operations and can be performed in 
30 any order. The use of these transforms m addition to translation means that structural sunilarities 
between the two images will not be obscured by reflection, rotation or differences m scale. 
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It is not essential to employ all three transformations. One may be used alone, or two in 
combination. It is probably rare that would want to allow reflection but not allow rotation, though 
it would be possible. If reflection about any axis were required, but not rotation, then either the 
reflection step could be modified to reflect about a randomly chosen axis, or (which amounts to flie . 
5 same thing) the rotation step could be retained but skipped when R=0. One might choose to allow 
scaling but not rotation in cases where similarities invariant to scale but not rotation are being 
sought - e.g. it might be required that diamond shapes aie to be distinguished from squares. 

In a further modification, values of parameters that result in a match may be recorded. A 
simple implementation of this would be, for example to record each rotation angle p that results in 
10 a match. These values could be averaged. For example an average p of 22^ could be useful as 
indicating that image B is rotated 20^ relative to image A. A spread in angles for each match 
would indicate a measure of circular symmetry present in both images. E.g. matches on a red ball 
in images A and B could occur for any angular rotation. 

Similar processing might be applied to die scale factors a. 

15 Another example is to compute, in the case of a match the position of the centroid gx of Xi 

and the centroid gu of uj. Averaging gx would give the position in image A of a region that is 
similar to a region at a position in image B given by the average of gu. In practice, since the 
centroid g is the average of x, (or Ui) then (if m constant) there is no need to calculate g and then 
average them; one could just average all the Xi (or uj) Again, this approach gives useful results only 

20 if the matches mamly result from one region in each image. A more sophisticated approach is to 
determine, for each match, whether the positions of Ifae centroids gx and are similar to the 
centroid pair recorded for a previous match. E.g. 

Dist(gx - gx') < e and Dist(gu - gu') < e (where Dist is the Euclidean distance or other 
distance operator and gx' gq' are the pair of centroids corresponding to an earlier match (or 
25 conceivably a running average of such earlier matched centroids) and e is some small threshold). 
This would imply that the match involved the same region as did the earlier match. One could 
then proceed by including the new result into the average only if this condition were satisfied. 
More than one average could be computed, for more than one different region, but to do this it 
would probably be more efficient to store ttie data for each match and process it at the end. 

30 The set of region correspondences may be used to track objects between video frames or 

obtam non-linear registration between images (e.g. the registration of mammograms taken at 
different times). If image A is simultaneously compared with multiple images B, C, D, . . . , Z, the 
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similarity measure may be used to detect the presence of specific objects or compare the state of 
scenes with a set of normal and abnonnal states (e.g. for security purposes). In a similar fashion 
the system may be used to identify facial expressions or facial identities. 

The same kind of averaging, conditional upon similarity of centroid positions could also 
5 be applied to the rotation angle(3. Such a process would indicate a strong similarity between a 
square and a diamond but only after a rotational transform of 45°, 135**, 225°, or 315°. 

Typical values for the' various parameters given above, for 600x400 images, are as follows 

mmin 1 
mmax 20 

Dmin 1 

Dmax A smaller value may be chosen for extracting region similarities, larger for global 

sunilarities. May range from 10 up to the smallest of the widths and heists of the two 
images 

5 30 (assuming that a lies in the range 0 to 255) 

5r, 6g, 5b 30 (assuming that r, g, b lie in the range 0 to 255) 
T 20000 

Pmin -90 
Pmax +90 
OniiD 0.5 
Otmax 2 
e 10 

In the case of images A, B both containing large plain areas of similar brightness (or 
colour), a large number of matches and hence a high score might be obtamed even though there 

10 may be little similarity between the parts of the image that contain, detail. In this case, the process 
need not necessarily be carried out for the whole image. For example, if regions of images A and 
B have been identified as being of special interest - perhaps using the method described m one of 
our earlier patent applications referred to above - then the picture elements x, u dealt with may be 
just those lying in the vicinity of the identified region. This could be implemented by constraining 

15 the selection of x and u such that at least one element Xi is an element of a special interest region of 
image A and at least one element uj is an element of a special interest region of image B. This 
means that each match establishes a similar relationship in each image between the foreground and 
background, or foreground and foreground (if all tines lie on high interest pixels). Small diameter 
forks will tend to obtain similarities between localised regions in A and B, and larger forks will 

20 determine global relationships between foreground and background. 

The methods described in two-dimensions can equally well be applied to one dimensional 
data such as temporal sequences of values (e.g. samples of an audio or other signal). However, 
rotation has no meaning in one dimension. They may likewise be applied in three (or more) 
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dimensions, where, however rotation requires more angles (up to n-1) to be specified if rotation is 
to be permitted about more fhan one axis. Rotation has meaning only if the disturbed dimensions 
are in the same category. Thus a three dimensional set of values representing a sequence of vbual 
images (x, y, t) (or a four -dimensional set representing a temporal sequence of three-dimensional 
5 visual images (x, y, z, t)) could be rotated only about axes parallel to the time axis. 

Discussion 

This method carries out an analysis of mdividual pairs of images and extracts structure that 
is common to both images. The amount of structure that is common to both unages gives a 
measure of their similarity. Unlike other methods the approach makes no use of pre-defmed 
10 feature measurements and it does not require representative training sets of images and associated 
processing to optimise recognition parameters. 

Scale and Orientation Differences 

Scale and orientation differences in the visual domain can arise because of perspective, 
viewing angle and other factors and it is common for prior knowledge to be incorporated in the 

15 classifier to compensate for such differences. Such prior knowledge is not necessary in this 

method because the matching process takes account of differences arising fi-om object orientation 
and scale. This means, for example, that the method can be applied to recognition problems in 
which the object to be recognised is embedded m another unage. This method therefore also has 
application to the problem of detecting copyright infiingement where portions of material have 

20 been cropped fi-om larger works (of art, for example), and the task of reducing the size of databases 
where it is known that duplication is prevalent. 

Local Distortions 

Unless provision is made for specific pattern content, the standard template approaches to 
pattern recognition fail when the patterns under comparison differ because of local distortions, or 
25 small movements, as would be the visual case with rustiing trees, moving clouds, chaiges in facial 
expression, scene-of-crime fingerprints on uregular surfaces, or noise, for example. Such 
provision requires prior knowledge of the application and will still cause the system to fail if the 
unseen pattern distortions do not conform to the system design requfa-ements. This method is able 
to minunise the effects of local distortions without prior knowledge of the type of distortion. 

30 The method is also able to cope with partial patterns that contain gaps and omissions. It 

therefore has direct application to the problem of identifying sceneof-crime fijigerprints where 
only a part of tiie total print is available for matching. In the case of facial recognition the method 
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lends itself to searches based upon restricted portions of the unknown face. This means, for 
example, that searches can be carried out purely on the ba^is of the eye and nose region in cases 
where beards and moustaches mig^t lead to ambiguity. However, the performance will degrade 
steadily as the distortions and gaps increase, but will not suddenly fail catastrophically. 

5 Image Classification 

The method may be used to calculate similarity scores between an image and a set of 
reference patterns. Similarity scores can be used to cluster groups of such patterns possessing high 
similarity scores relative to each other. Vant^e patterns to which other patterns in the cluster are 
similar, taken from each cluster may fliemselves be clustered to form supepclusters and the 

10 process continued to structure very large pattern databases. Query-By-Example retrieval is carried 
out by measuring similarity scores to each of the top level vantage patterns and then to each of the 
vantage patterns in sub-clusters corresponding to the highest scoring vantage pattern in the 
previous cluster. It is likely that some vantage patterns will represent clusters with common 
elements in those cases where patterns possess high similarity scores with more than one vantage 

15 pattern. Patterns that may be handled in this way include faces and facial expressions. It may be 
applied to the categorisation of images of manufactured or processed materials such as sand and 
aggregates). In a military context a flying object might be detected and values of similarity scores 
would reveal whether the object was likely to be a bird or a plane. 

The method may be applied to patterns of any dimension, such as one^imensional audio 
20 signals, three dimensional video data (x,y,time), or n-dimensional time dependent vectors derived 
from any source such as sensor arrays. In the case of speech recognition the method is able to 
handle variations in the speed of the speech without the use of special heuristics. A conventional 
approach uses Dynamic Time Warping to overcome this problem, but invokes greater 
computational effort and the danger of the warping process leading to increased misclassifications 
25 especi^ly in a large multi-class problem. Furthermore portions of utterances would be sufficient 
for word identification using this method if they were unique in the domain of discourse (e.g. 
'yeah* instead of *yes*, missing the final sibilant). 

Disparity Processing 

The method may be applied to the problem of disparity detection as is the case when 
30 detectmg motion or parallax. Standard approaches to disparity detection rely heavily upon 
accurate registration between two images so that the subtraction (which may be carried out 
piecewise for a small areas of the total image) takes place between pixels tiiat correspond to the 
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same points on the original object pictured in the two images. The resulting difference-image 
highlights those areas that correspond to differences in the original images. This becomes 
extremely difficult if noise is present as uncertainty is introduced into the estimate of the correct 
registration position and many spurious differences can be generated as a result. Even if noise is 

5 absent local distortions or slight subject movements will cause mis-registration and areas of 

difference will be highlighted which are of little interest unless the distortion or movement itself is 
being measured. Linear or non-linear digital image registration techniques prior to subtraction 
partially compensates but does not eliminate this problem in a large proportion of cases [4]. This 
method obtains registration by locating correspondences between similar regions in a pau* of 

10 images using features that are present in both regions; those regions that do not match are ignored. 
Such correspondences between regions in successive frames of a video can be applied to the 
problem of recognising and tracking moving objects. 

This method also has the advantage of being able to detect multiple disparities in which 
image A is compared with images B, C, D, etc. This would be useful in the case of CCTV intruder 
15 detection in which image frames B, C, D, etc would be typical examples of different atmospheric 
conditions and other normal background states, and an alarm would be raised only if disparities 
were detected in ail the normal image frames. It would also be applicable to the problem of 
measuring the likeness of facial images. 

Single Image 

20 Note that the method can be applied in the case where image A and image B are identical. Indeed, 
if desired, one could store a single image A in storage area 603 and storage area 604 becomes 
redundant (and references above to image B are replaced by knage A). 

In the case when image A is identical to image B, and the process is in effect considering a single 
unage, a high sunilarity score (Saa) may arise from application of the reflection transform if 

25 symmetry is present in the image across the axis of reflection. In a similar fashion rotational 
syinmetry and the presence of perspective symmetries may be detected. The distributions of 
rotation and reflection axis angles at which matches are found indicate the orientations of the 
symmetries present in the image. Forks should include some high attention scoring pixels 
otherwise large background tracts of self-matching sky, for example, would appear to exhibit 

30 trivial symmetries. This could be achieved by restricting the process to one or more areas 
identified as bemg of special interest, as discussed earlier. 
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Hardwoare Implementation 

The algorithm is eminently suitable for parallel unplementation as the processing for each 
pixel fork is independent of the processing of other forks. This means that processing of forks may 
be distributed across many independent sources of computation thereby obtaining processing 
5 speeds that are only limited by the rate of data capture. 

Some image analysis techniques cany out comparison calculations between unages using 
patches that are forks in which all the pixels are employed. Patches match when a measure of 
correlation exceeds a certain threshold. These approaches are unable to make best use of detailed 
structure that is smaller than the size of the patch except m the case in which the correlation 
10 measiu-e is designed to identify a specific texture. In addition such patches are of a defined size; if 
they are too large they fail to match anywhere; if they are too small they match in flie wrong 
places. The sparse pbcel forks used in this method do not suffer from these constraints. 
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Claims 

1 . A method of comparing a first pattern (A) represented by a first ordered set of elements 
(xi) each having a value with a second pattern (B) represented by a second ordered set of element 
(ui) each having a value, comprising iteratively performing the steps of: 

5 (i) selecting a plurality of elements fi-om the first ordered set ; 

(ii) for each selected element of tilie first ordered set, selecting an element fi:om the second 
ordered set, such that the selected elements of the second ordered set have, withm the second 
ordered set, a set of positional relationships relative to each other that is the same as, or a 
transformation of,^ the set of positional relationships that the selected plurality of elements of the 
10 first ordered set have relative to each other, 

(iii) comparing the value of each of the selected elements of the first ordered set with the 
value of the correspondingly positioned selected element of the second ordered set in accordance 
with a predetermined match criterion to produce a decision that the selected plurality of elements 
of the first ordered set does or does not match the selected plurality of elements of the second 
IS ordered set; 

(iv) in the event of a match, updating at least one similarity score (Sab); 

wherein the step of selecting the elements of the second ordered set comprises choosing at least 
one parameter (R, p, a) and selecting elements having a set of positional relationships (d/, d ")) that 
is transformed fi'om the positional relationship set (dj) of the selected elements of the first ordered 
20 set in accordance with the parameter(s). 

2. A method of analysing a pattem (A) represented by an ordered set of elements (xj) each 
having a value, comprising iteratively performing the steps of: 

(i) selecting a first plurality of elements from the ordered set ; 

25 (ii) for each selected element of the ordered set, selecting a further element from the 

ordered set, such that the selected further elements of the ordered set have, within the ordered set, 
a set of positional relationships relative to each other that is the same as, or a transformation of, 
the set of positional relationships that the selected first plurality of elements of the ordered set 
have relative to each other. 
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(iii) comparing the value of each of flie first selected elements of the ordered set with the 
value of the correspondingly positioned selected fiirther element of the ordered set in accordance 
with a predetermined match criterion to produce a decision that the selected first plurality of 
elements of the ordered set does or does not match the selected further plurality of elements of the 
5 ordered set; 

(iv) m the event of a match, updating at least one similarity score (Saa); 

wherein the step of selecting tiiie further elements of the ordered set comprises choosing at least 
one parameter (R, P, a) and selecting elements having a set of positional relationships (d/, di")) that 
is transformed fi-ora the positional relationship set (dO of the selected first elements of the ordered 
10 set in accordance with the parameter(s). 

3 . A method according to claim 1 or 2 m which the selection of a plurality of elements fi-om 
the first ordered set fi-om the ordered set is random or pseudo-random. 

15 4! * A method according to claim 1, 2 or 3 in which the selection of the parameter(s) is random 
or pseudo-random, . . . 

5. A method according to any one of the preceding claims in which the or a said parameter 
(R) determines whether or not a reflection should be applied to the positional relationships. 

20 

6. A method according to any one of the preceding claims in which the or a said parameter 
(P) determines whetiier and the degree to which a rotation is to be applied to the positional 
relationships. 

25 7. A method according to any one of the preceding claims m which the or a said parameter 
(a) determines whether and the degree to which a scaling is to be applied to the positional 
relationships. 

8. A method accordmg to any one of ttie preceding claims including analysmg those values 
30 of the parameters that result in a match. 
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9. A method according to any one of the preceding claims wherein the selections of elements 
in the first ordered set is such that their extent, within the ordered set, is biased towards a sniall 
extent rather than a large extent. 

5 

10. A method of comparing a first pattern represented by a first ordered set of elements each 
having a value with a second pattern represented by a second ordered set of element each having a 
value, comprising iteratiyely performing the steps of: 

(i) selecting a plurality of elements from the first ordered set ; 

10 (ii) for each selected element of the first ordered set, selecting an element from the second 

ordered set, such that the selected elements of the second ordered set have, within the second 
ordered set, a set of positional relationships relative to each other that is the same as, or a 
transformation of, the set of positional relationships that the selected plurality of elements of the 
first ordered set have relative to each other, 

1 S (iii) comparing the value of each of the selected elements of the first ordered set with tiie 

value of tiie correspondingly positioned selected element of the second ordered set in accordance 
with a predetermined match criterion to produce a decision that the selected plurality of elements 
of the first ordered set does or does not match the selected plurality of elements of the second * 
ordered set; 

20 (iv) in the event of a match, updating at least one similarity score; 

wherein the selections of elements m the first ordered set is such that theur extent, within the 
ordered set, is biased towards a small extent rather than a large extent 

1 1 A method according to claim 9 or 10 comprising defining a bounded region of the first 
25 ordered set, said bounded region having a randomly selected size (D), and constraining selection of 
the elements such that the selected elements lie entirely within the defined bounded region. 



12. A method according to any one of the preceding claims in which, on each iteration, the 
munber of elements (m) to be selected from the first ordered set is selected at random, and in 



wo 2006/030173 



PCT/GB2005/003339 



-16- 

which fhe step of updating the score increments tiie score by an amount which is a monotonicaliy 
increasing function of the number (m) of elements. 

13. A method of comparing a first pattern represented by a first ordered set of elements each 
5 having a value with a second pattern represented by a second ordered set of element each having a 
value, comprising iteratively performing the steps of: 

(i) selecting a plurality of elements fi-om the first ordered set ; 

' (ii) for each selected element of the first ordered set, selecting an element fi-om the second 
ordered set, such that the selected elements of the second ordered set have, within the second 
10 ordered set, a set of positional relationships relative to each other that is the same as, or a 

transformation of, the set of positional relationships that the selected plurality of elements of the 
first ordered set have relative to each other, 

(iii) comparing the value of each of the selected elements of the first ordered set with the 
value of the correspondingly positioned selected element of the second ordered set in accordance 
IS with a predetermined match criterion to produce a decision that the selected plurality of elements 
of ihe first ordered set does or does not match the selected plurality of elements of the second 
ordered set; 

(iv) in the event of a match, updating at least one similarity score; 

in which, on each iteration, the number of elements (m) to be selected fi-om the first ordered set is 
20 selected at random, and in which the step of updating the score increments the score by an amount 
which is a monotonicaliy increasing fimction (f(m)) of the number (m) of elements. 



14. A method according to claim 12 or 13 in which the function of the nimiber (m) of elements 
is equal to the number of elements. 

25 

15. A method according to claim 12 or 13 in which the function increases more rapidly than 
the number (m) of elements than does the number (m) of elements. 

16. A method according to any one of the preceding claims, in which each value (a) comprises 
30 a plurality of components. 
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17. A method according to any one of the preceding claims, comprising firstly processing the 
first and second ordered set to identify regions thereof containing significant detail, and in which 
the selection of elements is constrained such that at least one of the selected elements of the fu-st 

5 ordered set shall lie in the or an identified region of the first ordered set and/or that at least one of 
the selected elements of the first ordered set shall lie in the or an identified region of the first 
ordered set. 

18. A method according to any one of the preceding claims mcluding analysing those values 
10 of the selected element positions that result in a match. 
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